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CHAPTER  J 


INTHODIT'TION 


Contents  and  Organization  of  Report 


Chaper  I contains  the  study  objectives  and  a discussion  of  the 
applicability  of  the  newly  developed  Optimal  Spline  Method  to  ship 
classification  and  to  the  system  identification  of  aircraft  nonlinear 
aerodynamic  flight  regimes.  Summarized  in  Chapters  11  and  111  are 
its  successful  application  to  ship  classification  work  and  to  an  on  going 
aircraft  identification  study^.  A detailed  mathematical  development  of 
the  Optimal  Spline  Method  is  derived  in  Chapters  IV-X.  Chapter  IV 
contains  a mathematical  description  of  the  problem  investigated  in  the 
study.  Six  different  cases  of  the  problem  are  discussed  in  Section  4.4. 

The  Optimal  Spline  Method  is  derived  in  Chapter  V as  a solution  to  the 
posed  problem  of  Chapter  IV.  The  analytical  expressions  for  the  quanti- 
ties of  Case  1 (i.e.  the  case  applicable  to  aircraft  system  identification) 
are  derived  in  Chapters  VI  and  Vll.  The  analytical  expressions  for  the 
ship  classification  case  (i.e.  Case  2)  are  derived  in  Chapter  \ III.  Cases 
3-6  are  treated  in  Chapter  K.  The  procedure  that  determines  the  starting 
estimates  of  the  knots  and  their  locations  is  described  in  Chapter  . 
Chapter  XI  gives  the  conclusions. 


t Study  to  Develop  and  Apply  Nonlinear  State  Estimation  and  Parameter 
Identification  Techniques  to  the  High  Angle  of  Attack/ Sideslip  Flight 
Regime  of  Conventional  Aircraft  and  to  the  Hover  and  Low -Speed  Flight 
Regimes  of  V / STOI.  Aircraft.  Contract  No.  N62269-76-C -0342 , Naval 
Air  Development  Center,  Warminster,  Pennsylvania  18974. 
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1.2 


Study  Objectives 

A nonlinoai-  function  can  be  chopped  into  subarcs  having  small 
nonlinearities  whiih  can  be  adequately  represented  by  simple  spline 
functions.  'I'he  domain  of  a suliarc  is  called  a spline  region  and  a point 
joining  one  spline  region  with  an  adjacent  one  is  called  a knot,  'I'he 
piecewise  combination  of  the  simple  spline  functions  that  fit  the  subarcs 
is  a spline  representation  of  the  nonlinear  function.  Spline  representa- 
tions can  closely  approximate  the  nonlinearities  of  any  function,  'fhe 
goodness  of  fit  depends  on  the  number  of  spline  regions  and  on  the  location 
of  the  knots.  'I'he  first  objective  of  this  study  is  to  derive  an  automated 
method  that  minimizes  the  number  of  spline  regions  and  optimizes  the 
locations  of  the  knots  to  provide  an  adequate  fit  of  a given  nonlinear 
function.  This  has  been  accomplished  by  the  development  of  the  Optimal 
Spline  Method  discussed  herein,  'fhe  second  objective  is  to  apply  the 
derived  automated  method  to  two  important  applications.  'I'his  objective 
[ has  been  accomplished  by  the  successful  application  of  the  Optimal  Spline 

1^  Method  to  ship  classification  and  to  system  identification  of  aircraft  non- 

linear aerodynamic  flight  regimes. 

I 

1.3  Applicability  of  the  Optimal  Spline  Method  to  Ship  Classification 

f A major  technological  area  challenging  our  U.S.  Fleet  is  the 

over-the-horizon  detection,  classification  and  targeting  of  surface  ships. 
The  introduction  of  weapons  like  the  HARPOON,  the  TOMAHAWK,  and 
the  ALCM  have  brought  about  new  requirements  in  ocean  surveillance. 
Active  and  passive  sensors  are  required  to  provide  beyond  the  horizon 
knowledge  of  all  vessels  under  all  weather  and  communication  conditions. 
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A large  gap  in  surveillance  capability  cui-renlly  exists  in  bad  weather 
for  non -communicating  targets.  The  high  range  resolution  radar  system 
is  a candidate  having  great  potential  to  fill  this  gap.  Current  technology 
allows  the  existence  of  radar  systems  capable  of  obtaining  surface  ship 
signatures  (stern-bow  profiles)  having  classification  potential^^ ^ . 

Accordingly,  identifying  a ship  signature  is  largely  a software  problem. 

This  report  provides  a very  important  contribution  to  this  area  by 
presenting  a new  technique  - an  Optimal  Spline  Method  - which  generates 
the  independent  features  of  a ship  signature  for  classification  purposes. 

The  integrated  signal  returns  of  a high  range  resolution  radar 
system  provide  data  from  which  the  radar  cross-section  per  range  cell 
of  a ship  can  be  estimated.  Radar  cross-section  is  a measure  of  the 
amount  of  a ship's  superstructure  contained  in  a range  cell.  Consequently, 
a graph  of  the  radar  cross-sections  per  range  cell  drawn  over  a ship's 
length  (i.e.,  a stern-bow  profile)  provides  a means  for  classifying  ships. 

The  stern-bow  profiles  are  the  signatures  for  ship  classification.  The 
separate  superstructure  masses  provide  peaks  in  the  profile  while  the 
absence  of  superstructure  appears  as  valleys.  An  automated  technique 
is  needed  for  determining  the  number  of  separate  superstructure  masses, 
their  separation  from  each  other,  their  locations  and  their  extended  widths. 

These  are  the  independent  features  of  a ship's  stern-bow  radar  cross-section 
profile.  The  Optimal  Spline  Method  is  an  automated  technique  that  fulfills 
this  need. 

Stern-bow  profiles  of  ships  lend  themselves  well  to  quadratic  spline 
representations.  Quadratic  spline  functions  have  the  flexibility  to  fit  any 
ship's  stern-bow  profile  and,  most  importantly,  they  have  coefficients 
that  represent  the  independent  features.  These  functions  are  mathemati- 
cally described  in  Section  4.  2.  The  spline  coefficients  provide  the  features 
for  pattern  recognition,  and  they  are  equal  to  the  number  of  spline  regions. 
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'I'he  problem  of  identil'ying  a patteiTi  increases  exponcmlially  with  the 
number  of  features.  Each  set  of  data  contains  a fixed  number  of  inde- 
pendent features.  If  too  many  spline  regions  are  used  the  independent 
features  are  distributed  into  a higher  number  of  spline  coefficients.  In 
this  case  the  set  of  spline  coefficients  form  a dependent  set  of  features, 
making  the  classification  problem  unnecessarily  complex.  An  indepen- 
dent set  of  features  can  be  determined  by  minimizing  the  number  of 
spline  regions.  This  can  be  accomplished  by  optimizing  on  the  locations 
of  the  spline  regions  for  each  fixed  number  of  knots  and  by  minimizing 
the  number  of  knots.  This  is  precisely  what  the  Optimal  Spline  Method 
accomplishes. 


1 . 4 Applicability  of  the  Optimal  Spline  Method  to  Aircraft  System 
Identification 


The  inability  of  empirical  and  theoretical  techniques  to  accurately 
predict  the  nonlinear  aerodynamics  of  the  high  angle  of  attack/ sideslip 
domain  for  conventional  aircraft  and  the  propulsion  induced  aerodynamics 
on  V/STOL  aircraft  has  spurred  interest  in  extracting  these  effects  from 
actual  flight  data.  Efforts  to  develop  suitable  nonlinear  state  estimation 
and  parameter  identification  techniques  for  application  to  the  high  angle 
of  attack/ sideslip  flight  regime  of  conventional  aircraft  have  been  under- 
way for  several  years.  Dynamics  Research  Corporation  (DRC)  has 
developed  a unique  proprietary  approach  to  nonlinear  state  estimation 
and  parameter  identification  called  the  Estimation-Before-Modeling  (EBM) 
identification  method  which  determines  state-dependent  aerodynamic 
models  for  the  forces  and  the  moments  acting  on  CTOL  and  V/STOL  air- 
craft in  any  flight  regime.  DRC  is  currently  under  contract  to  the  Naval 
Air  Development  Center  to  model  a conventional  aircraft  and  a V/STOL 
aircraft  using  the  EBM  identification  method. 


4 


1 


The  EBM  identification  method  covers  two  phases  --  state  esti- 
mation followed  by  model  structure  and  parameter  determination.  During 
the  state  estimation  phase  noisy  flight  records  are  processed  by  a unique 
proprietary  DKC  estimation  approach  which  uses  quadratic  spline  functions  in 
generating  optimal,  smoothed  time  histories  of  all  aircraft  states,  forces 
and  moments.  Various  applications  of  spline  functions  are  given  in 
References  [2-12J.  Quadratic  spline  functions  are  used  in  DRC's  approach 
to  model  the  unknown  time  histories  of  the  forces  and  of  the  moments. 

Each  quadratic  spline  function  is  a function  of  parameters  called  knots 
as  well  as  a function  of  time.  The  location  of  the  knots  influence  the 
performance  of  the  estimation  unless  a sufficiently  large  number  of 
knots  are  used  in  the  modeling  of  each  force  time  history  and  of  each  moment 
time  history.  There  is  a limit,  however,  to  the  practical  number  of  knots 
that  can  be  used  in  a computer  program.  That  is,  the  number  of  simu- 
ltaneous equations  that  must  be  solved  in  the  estimation  process  grows 
at  the  rate  of  one  parameter  per  knot  per  quadratic  spline  function.  Since 
there  are  6 quadratic  spline  functions  - one  for  each  of  three  forces  and 
one  for  each  of  tliree  moments  - the  number  grows  at  the  rate  of  6 per 
knot.  For  the  case  of  1 0 knots  per  quadratic  spline  function  there  is  a 
total  of  87  simultaneous  equations;  the  additional  27  simultaneous  equa- 
tions are  due  to  parameters  other  than  those  related  to  knots.  The 
c'omputations  and  the  storage  requirement  of  the  estimation  process 
grows  exponentially  with  the  number  of  knots.  Consequently,  it  is  advan- 
tageous to  use  as  few  knots  as  possible  while  maintaining  an  excellent 
estimation  performance.  This  advantage  is  realizable  by  optimally 
selecting  the  knot  locations.  The  Optimal  Spline  Method  is  an  automated 
technique  that  performs  an  optimization  of  the  knot  locations  and  as  a 
result  better  models  of  the  force  and  moment  time  histories  are  obtained. 
leading  to  improved  system  identification  of  aircraft. 
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^ I 

The  Optimal  Spline  Method  is  being  utilized  in  a study  to 
^ develop  and  apply  nonlinear  state  estimation  and  parameter  identi- 

fication techniques  to  high  angle  of  attack/ sideslip  flight  regimes 
' of  conventional  aircraft  and  to  hover  and  low -speed  flight  regimes 

of  V/STOL  aircraft.  The  results  [13]  of  one  phase  of  that  study  will 
be  presented  at  the  4th  AIAA  AFM  Meeting  in  August  8-10,  1977. 
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CHAPTER  1] 


RESULTS  OP  AN  APPl.lCATJON  OF  THE  OPTIMAL 
SIT  INE  METHOU  TO  SHIP  C'LASSIFIC ATION 


In  Figure  2-1  it  is  shown  how  the  Optimal  Spline  Method  fits  into  DKC's 
approach  to  ship  classification.  Note  that  it  is  the  final  block  in  the  feature 
selection  process.  Specifically,  it  extracts  the  important  features  of  the 
IRFP  stern-bow  profile.  The  IRFP  stern-bow  profiles  are  generated  by  the 
Image  Reconstruction  From  Projections  (IRFP)  Method  which  reconstructs 
stern-bow  images  using  high  range  resolution  radar  data.  Before  presenting 
the  results  of  an  application  of  the  Optimal  Spline  Method  to  ship  classification 
it  is  necessary  to  discuss  the  background  of  IRFP  stern-bow  profiles. 

A test  bed  high  range  resolution  radar  system  having  a resolution  of 
50  feet  was  used  in  a Naval  Research  Laboratory  Measurerr^nt  Program 
sponsored  by  the  Navy  Space  Project  Office  (PME-106)  of  the  Naval  Electronic 
Systems  Command  to  generate  profile  data  of  fifteen  ship  types.  Examples 
of  the  radar  data  collected  on  passes  over  each  of  three  ship  types  are  shown 
in  the  top  three  plots  (1st,  2nd  and  3rd  projections)  of  Figures  2-2  through 
2-5.  The  IRFP  method  which  was  applied  to  the  top  three  plots  generated 
the  bottom  plot  called  the  reconstructed  image  of  the  stern-bow  profile 
(i.e.,  IRFP  stern-bow  profile).  On  Run  No.  38/PassNo.  8oftheU.  S.S. 
BARNEY  the  upper  three  profiles  of  Figure  2-2  were  taken  at  the  aspects 
(measured  clockwise  from  the  ship's  bow)  202°,  165°  and  135°,  respectively. 
Note  the  measured  radar  cross-sections  362,  5540,  and  2061  square  metei'S 
taken  at  the  first,  second  and  third  projections,  respectively.  The  projected 
length  of  the  ship  at  each  projection  is  noted  also.  The  horizontal  axis  of 
each  plot  denotes  the  number  of  range  cells  (50  feet  per  range  cell)  measured 
from  the  stern  to  the  bow  along  the  projection.  The  vertical  axis  denotes 
the  radar  cross-section  of  the  ship's  portion  contained  in  the  range  cell. 
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Figure  2-1  Block  Diagram  of  DRC's  Ship  Classification  Approach 
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Figure  2-3  IHI'P  Results  of  Run  No.  40/Pass  No.  6 on  the  U.S.  S.  BARNEY 
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The  bottom  profile  is  the  output  of  the  IHFF  method  resultirifr  from  the 
input  of  the  upper  three  profiles.  This  is  the  reconstructed  image  of 
the  U.S.S.  RAKNEY.  The  left  end  of  the  i)rofile  represents  the  stern 
and  the  right  end  the  bow.  The  IRFP  results  of  another  pass  over  the 
U.S.S.  BARNEY  are  given  in  Figure  2-3.  A broadside  drawing  of  the 
U.S.S.  BARNEY  (DDG-G)  is  given  in  Figure  2-G.  Note  the  similarity 


between  the  IRFP  stern-bow  profiles  of  Figures  2-2  and  2-3  and  the 
superstructure  of  the  U.S.S.  BARNEY  in  Figure  2-6.  The  IRFP  results 
of  a pass  over  the  U.  S.  S.  Dahlgren  and  of  a pass  over  a Danish  tanker 
(the  ESSO  DENMARK)  are  given  in  Figures  2-4  and  2-5,  respectively. 

A drawing  of  the  U.S.S.  DAHLGREN  is  presented  in  Figure  2-7.  A 
picture  of  the  ESSO  DENMARK  is  shown  in  Figure  2-8.  In  all  passes 
the  upper  three  profiles  have  been  normalized  to  a total  cross-section 
of  the  projection  that  lies  between  the  cross-section  of  the  other  two 
proiections.  The  IRFP  profile  has  been  normalized  to  this  same  cross- 
section. 

The  results  of  the  application  of  the  Optimal  Spline  Method  to  the 
IRFP  stern-bow  profiles  of  Run  38/Pass  8,  Run  40/Pass  6,  Run  32/Pass  1 
and  Run  44/Pass  1 are  contained  in  Figures  2-9  through  2-12,  respectively. 

In  this  application  the  radar  cross-section  is  normalized  to  unity.  The 
coefficient  of  the  optimal  spline  function  for  each  spline  region  is  symbolized 
by  the  notation  "PBAR”.  Optimally  placed  knots  are  denoted  by  the  notation 
''OPTIMAL'',  h’or  example,  in  Figure  2-9  the  value  of  , (i.e.,  the  first 
component  of  the  p vector  Equation(4. 16))  for  the  first  spline  region 
[0.0,  0.72]  is  equal  to  0.19;  the  first  knot  is  optimally  located  at  0.72.  The 
second  knot  is  optimally  placed  at  2.75.  Since  each  range  cell  represents 
50  feet  along  the  ship's  length  and  since  the  stern  starts  at  zero  it  follows  that 
the  first  knot  falls  at  0.72  x 50  feet  = 36  feet  from  the  stern,  the  second  at  138 
feet,  etc. 
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Figure  2-7.  Broadside  Drawing  of  the  U.S.  S.  DAHIX'.BL'N  (D1X.-12) 


rigure  2-8.  ESSO  DI’NAEM^K  Tanker,  Length  = (177  feet,  4M.  2 ft.  Divisions 
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Figure  2-9,  Optimal  Spline  Method  Results  of  Run  No.  38/1’ass  No. 


Figure  2-11.  Optimal  Spline  Method  Results  of  Run  No.  32/Pass  No. 
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-12.  Optimal  Spline  Results  of  Hun  No.  44 /Pass  No. 


The  number  of  knots,  an  output  of  the  Optimal  Spline  Method,  is  five 
for  both  U.S.S.  BARNEY  passes  - Figures  2-9  and  2-10.  Note  that  eight  knots 
were  calculated  for  the  U.S.S.  DAHLOREN  and  seven  for  the  ESSO  DENMARK 
- Figures  2-11  and  2-12,  respectively.  The  knot  locations  and  the  optimal 
spline  coefficient  values  are  tabulated  in  Tables  2-1  and  2-2. 

Analyzing  the  first  two  columns  of  Table  2-1  and  the  first  two  columns 
of  Table  2-2  we  see  that  for  both  U.S.S.  BARNEY  passes  the  knot  locations 
and  the  coefficient  values  are  in  good  agreement.  Looking  at  the  third  column 
of  Table  2-2  we  observe  that  the  coefficients  for  the  U.S.S.  DAHLGREN 
differ  from  those  of  the  U.S.S.  BARNEY  in  sign  as  well  as  in  magnitude.  These 
differences  together  with  the  difference  of  5 knots  for  the  U.S.S.  BARNEY 
versus  8 knots  for  the  U.S.S.  DAHLGREN  make  it  easy  to  distinguish  these 
two  ship  t3^)es. 


It  is  also  easy  to  distinguish  between  the  ESSO  DENMARK  and  the 
U.S.S.  BARNEY  because  (1)  there  are  five  knots  for  the  U.S.S.  BARNEY 
and  seven  for  the  ESSO  DENMARK,  (2)  their  knot  locations  differ  consider- 
ably and  (3)  their  optimal  spline  coefficients  differ  greatly  in  magnitude  for 
some  of  the  spline  regions. 

Furthermore,  it  is  easy  to  distinguish  between  the  ESSO  DENMARK 
and  the  U.S.S.  DAHLGREN  because  (1)  their  coefficients  differ  in  sign  and 
(2)  they  have  differences  in  knot  locations. 

Optimally  locating  the  knots  has  two  advantages.  The  first  is  the 
extraction  of  the  independent  features  for  classification  purposes.  The 
second  is  the  reduction  of  the  least-squares  error.  In  Table  2-3  is 
presented  a comparison  of  the  least-squares  error  between  optimally  located 
knots  and  equally  spaced  knots.  The  least-squares  error  of  Run  No.  38/ 
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Pass  No.  8 for  optimally  located  knots  is  . 01  and  the  error  of  the  same 
run  for  equally  spaced  knots  is  .87.  The  ratio  of  the  error  associated 
with  equally  spaced  knots  to  the  error  associated  with  optimally  located 
knots  is  87.  In  all  cases  this  ratio  is  greater  than  10. 
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UESUI/rS  OF  AN  APPLICATION  OF  I'llE  OPTIMAL  SPLINE 
METHOD  TO  AIRCRAFT  SYSTEM  IDENTIFICA'l'ION 


Aerodynamic  derivatives  are  highly  dependent  on  the  angle  of 
attack  variable  a and  the  sideslip  angle  variable  8.  Thus,  these  angles 
are  important  state  variables  in  the  state -dependent  modeling  of  the 
forces  and  the  moments  that  act  on  an  aircraft.  Presented  in  Figures 
3-1  and  3-2  are  applications  of  the  Optimal  Spline  Method  to  angle 
of  attack  and  sideslip  angle  flight  test  data  of  a light  jet  trainer  air- 
craft. The  Optimal  Spline  Method  calculated  twelve  knots  for  the  angle 
of  attack  data  and  optimally  located  them  as  shown  in  Figure  3-1.  It  calcu- 
lated eight  for  the  sideslip  angle  and  optimally  located  them  as  shown 
in  Figure  3-2.  The  first  knot  denoted  by  "OPTIMAL"  for  the  sideslip 
angle  is  optimally  placed  at  4.  62  seconds;  the  spline  coefficient  which 
is  denoted  by  "PBAR"  is  0.  02  for  the  first  spline  region,  0,  30  for  the 
second  spline  region,  etc. 

Equally  spaced  knots  have  been  used  to  fit  the  same  angle  of 
attack  and  sideslip  angle  data.  The  result  of  using  twelve  equally  spaced 
knots  on  the  angle  of  attack  data  is  shown  in  Figure  3-3.  The  fit  is 
not  adequate  at  the  times  3.  5,  5.  5,  7.  5,  9.  3,  10.  7,  13.  7,  and  14.  7. 

At  each  of  these  times  the  smooth  curve  falls  outside  the  statistical 
limits  of  the  noise.  Shown  in  Figure  3-4  is  the  result  of  the  use  of 
eight  equally  spaced  knots  for  the  sideslip  data.  An  unsatisfactory 
fit  is  even  more  pronounced  here  than  it  is  in  Figure  3-3.  Conse- 
quently, equally  space  knots  provide  unsatisfactory  smoothing  unless 
an  abundance  of  them  are  used.  The  Optimal  Spline  Method 
provides  an  adequate  fit  with  a reduced  number  of  knots  by  optimally 
locating  them  so  that  the  resulting  smooth  curve  can  stay  in  phase 


Optimal  Spline  Method  Application  to  Angle  of  Attack  Data 
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Figure  3-2.  Optimal  Spline  Method  Application  to  Sideslip  Angle  Data 


Knots  Results  of  Angle  of  Attack  Data 


CHAPTKK  IV 


MATHEMATICAL  DESCilIPTlON  OF  PROBLEM 


4.  1 Time  Function  Representations 

The  problem  being  investigated  deals  with  the  representation  of  a 
time  function  by  the  superposition  of  a family  of  simple  functions  which 
are  easy  to  define,  generate  and  implement.  In  particular,  it  is  sought 
to  minimize  the  number  of  parauneters  in  such  representations,  while 
maintaining  a required  degree  of  accuracy. 

Let  f(t)  denote  a square  integrable  time  function  defined  over  a time 
interval  [T^,  T^].  Let  d(t)  be  a measured  time  history  of  f(t): 

d(t)  = f(t)  + T7  (4.1) 

where  rj  is  a stationary  Gaussian  process  with  variance 

Let  { n = 1,  2, } denote  the  family  of  simple  square  integrable 

functions  to  be  used  in  the  superposition.  Since  only  a finite  number  of 
terms,  N,  is  possible  for  a practical  realization  of  f(t),  it  is  necessary 

to  choose  coefficients  qj,  q2» . so  as  to  render  a minimum  to  the 

criterion: 

Tf  N 

E = J [ d(t)  - E q a (t)  r dt  (4.  2) 

T n=l 

o 
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I'or  the  ease  a complete  orthonormal  function  series  {e.g.,  Fourier, 
V\alsh,  Haar)  the  minimum  is  attained  by  making 


f 

q,,  = J d(t)  o^(t)  dt 

* o 

and  the  error  F monotonieally  de  ’ ceases  to  the  variance  fj"  as  N 
becomes  very  large. 


(1.3) 


The  advantage  of  using  orthogonal  series  is  the  ease  with  whicli  the 

optimum  of  (4.  2)  are  computable,  i.  e.  , using  Equation  (4.  3). 

I'Tequently,  a large  value  of  N is  needed  in  order  that  the  error  E is 

2 

sufficiently  close  to  a . Large  values  of  N are  disadvantageous  in 
some  applications  (e.g.  , ship  classification  and  aircraft  system  identi- 
fication). There  are  nonorthogonal  function  series  that  provide  excellent 
fits  and  use  only  small  values  of  N. 


One  such  nonorthogonal  series  is  composed  of  quadratic  spline  functions. 

Before  introducing  these  functions  the  solution  of  (4.2)  will  be  derived 

T 

for  nonorthogonal  series.  Definet  the  row  vector  q as 


T 


'^2'  ■■■’  '^n^ 


the  row  vector  a^(t)  as 


(4.4) 


a^(t)  = (a  (t),  0!„(t).  — , a (t)) 

— 12  n 


(4.  5) 


tThe  superscript  'I'  denotes  transpose. 


I 

I 
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and  the  matrix  It  whose  i 


row  and  column  element  b.  is  civen  by 

ij 


b. 


ij 


T 


a.(t)  (X  (t ) dt 
1 J 


(Lb) 


'J'he  solution  of  (4.2)  is  given  by 


T , 

H ^ ^ d(t)  a(t)  dt 


(4.7) 


For  the  case  that  B is  the  identity  matrix  this  solution  reduces  to  (4.3). 


4.2  QFADRAdlC  SPIJNR  FUNCTIONS 

Consider  the  following  general  2nd  order  nonlinear  differential  equation 
r(t)  = f (t,  r(t),  r(t))  (4.8) 


I 


where  r and  f are  scalars  and  where  f is  a continuously  differentiable 

function.  Integrating  both  sides  of  this  equation  twice  with  respect  to 

time  over  the  interval  [T  , t]  gives 

o 

r(t)  = r(T  ) 4 r(T  ) (t  - T ) + '^^  '"L  f(s,  r(s),  r(s))  ds  dr  (4.9) 

o o o ''  T T 

o o 

The  double  integral  can  be  rewrittn  as 

6 (s,  t)  f (s,  r(s),  r(s))  ds  dr 

o o 

where 


6 (s,  t)  = { 


1 s ^ T 

0 s > T 
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(4. 10) 


Interchanging  llie  order  of  integration  and  carrying  out  tlie  integration 
results  in 


i 


I 


(t  - s)  f (s,  r(s),  r(s))  ds 
‘ o 

Consequently  r(t)  can  be  rewritten  as 


r(t)  = r ^ r (t  - 1 ) + (t  - s)  f (s,  r(s),  r(s) ) ds  (4.11) 

o o o “1 

o 

A . A • 

where  r = r(T  ) and  r = r(T  ).  This  equation  is  the  integral 
o o o o 

equivalent  of  the  differential  equation.  The  integral  term  is  evaluated 

as  follows:  The  total  time  domain  of  interest  [T  > T.l  is  divided  into  a 

‘ o f 

number  of  subregions  [T.  T ],  j = 1,  2, , m+1  called  "splines". 

J”l»  ] 

The  points  T, , T„, , T are  called  knots.  Here,  T = T ,.  'I'he 

12  m m+1  1 

integral  can  be  written  equivalently  as  a sum  of  integrals  over  each 
spline  region,  i.  e.  , 


A 

r(t)  = (t  - t^)  + T f 

^k-1 

J.p  (t  - s)  f (s,  r(s),  r(s))  ds 


(t  - s)  f (s,  r(s) ) ds 


(4. 12) 


where  tc  [T  _.,  T ],  j = 1,  2, , m+1.  By  choosing  sufficiently  many 

^ • , 

splines  we  can  model  f (s,  r(s),  r(s) ) as  a constant  m over  each  spline 

region  [T.  T.],  j = 1,  2, , m+1.  With  this  approximation  r(t) 

J J 

becomes 


k=  1 


(4. 13) 
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where  te  ['1\  T^].  'I'his  is  the  quadratic  spline  function.  The  family 

of  such  functions  is  generated  by  letting  the  knots  and  the  parameters 


r . r ,*r,, , r vary  over  their  regions  of  definition.  In  vector 

o o 1 m 


o'  o'  r ' m 

form  the  quadratic  spline  function  can  be  written  as 


r(t)  = a (t;  T)  • p 


where  the  knot  vector  T is  given  by 


T = (T,.  T^. 


where 


P = (ri 


r . . r . r ) 
m+1  o o 


a (t;  T)  = (a^  (t;  T).  (t;  T), 


“m.3  - To 


and  where,  for  j = 1,  2,  ....  m+1. 


0 T s.ts,T.  , 
o j-1 


a.  (t;  T) 


(t  - T ) 


T.  s t « T. 
J-1  3 


T + T. 

(T . - T ) (t  - L ) t ^ T . 

J J ^ J 


J 


I 


I 

1 


I 

\ 


I 


t 


In  an  application  to  ship  classification  the  function  r represents  the 
radar  cross-section  per  unit  range  resolution  (i.e.,  density)  along  the 
length  of  the  ship  from  the  stern  to  the  bow.  Since  this  density  is  zero 
at  the  beginning  of  the  stern  and  at  the  end  of  the  bow  the  constraints 

r = 0 (4.21) 

o 

r(T  ) = 0 (4.22) 

m t-i 

must  necessarily  be  invoked.  The  coefficients  r , J = 1,  2,  ....  m+1 
provide  a composite  picture  of  the  ship's  superstructure. 

To  put  the  quadratic  spline  function  in  the  notation  of  Section  4.  1 let  the 
vector  T be  fixed  and  define 

a.(t)  = aXt;  T)  j = 1.  2.  N (4.23) 

where  N = m+3.  The  vector  corresponds  to  the  vector  p. 


4.  3 A GENERAL  TIME  FUNCTION  OPTIMIZATION  PROBLEM 

The  quadratic  spline  functions  introduced  in  the  previous  subsections 
provide  a family  of  simple  functions  for  the  representation  of  a time 
function.  The  quadratic  spline  functions  form  a nonorthogonal  function 
series  that  quadratically  depend  on  a parameter  set  T of  knots.  In 
general,  then,  a family  of  simple  functions  for  time  function  representa- 
tion will  depend  on  a set  of  parameters  such  as  T and  the  dependence 
will  be  possibly  nonlinear.  Consequently  a general  time  function 


35 


optimization  problem  has  the  error  criterion 

E((j,  T)  = [d(t)  - (t;  T)  • gj^  dt  (4.24) 

o 

where 

T 

q = (q^.  q2»  q^^  (4.25) 

(t;  T)  = (a,  (t;  T),  (t;  T),  ....  (t;  T))  (4.26) 

and  where  the  (m+1)  dimensional  vector  T denote  the  set  of  parameters 

on  which  the  simple  functions  (t;  T),  i = 1,  2, , N,  depend.  In 

the  case  of  quadratic  splines  the  vector  T represents  the  set  of  knots. 

Since  the  argument  q occurs  linearly  inside  the  square  brackets  the 
error  criterion  E(q,  T)  can  be  minimized  with  respect  to  q,  holding 
T fixed,  to  give  an  analytical  expression  for  q as  a function  of  T. 
Equation  (4.24)  can  be  rewritten  as 

T 

E (q.  T)  = [d^(t)  - d(t)  (t,  T)  . q ] dt 

o 
T 

- [d(t)  - (t;  T)  . q]  (t;  T)  • q dt  (4.27) 

o ~ “ 

Minimizing  E (q,  T)  with  respect  to  q gives 

T 

[d(t)  - (t;  T)  • q a.  (t;  T)  dt  = 0,  j = 1.  2,  N (4.  28) 

Or,  equivalently,  in  matrix  form 
A 

B(T)  q(T)  = 2:  (T)  (4.29) 
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^here  q (T)  denotes  the  optimum  q.  the  vector 


('!')  = (y.  (T).  To  (J)- 


(4.  30) 


has  components 


T 

('!')  - r ^ d(t)  ot  (t;  4’)  dt.  J = 1.  2,  . N 

J - ^ 


(4.31) 


and  the  matrix  H (T)  has  elements 


b (T)  = r,/  a (t;  T)  a (t;  T)  dt.  i,  j = 1.  2.  N (4.32) 

ij  - ''‘o'  ■* 

Substituting  the  optimum  q (T)  into  (4.27)  gives 

E(5(T).  T)^  j"/d^t)dt-f  d(t)  J(t.  T)  . q(T)dt  (4.33) 
since  the  second  integral  oi  (4.27)  is  zero  by  way  of  (4.28). 


Using  the  definition  of  ^ (J)  we  can  rewrite  (4.33)  as 


(q  (T),  T)  = J./  d'^(t)  dt  - y ■ (T)  • q (T) 


(4.34) 


Since  the  first  term  is  independent  of  T it  will  have  no  bearing  on  the 
generation  of  the  optimum  T.  Consequently,  we  redefine  the  error 


criterion  E as 


E (T)  = 2^  (T)  b'^  (T)2<T) 


(4.35) 


which  is  the  last  term  of  (4.34). 


I 
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Our  objective  is  to  maximize  (4.35)  with  respect  to  the  knot  vector  T 
in  the  presence  of  the  constraints 


T.  , ^ T.,  i = 1.  2.  m+1 

i“  1 1 


(4.36) 


where  T = T„. 

m 1 1 t 


4.4  VARIOUS  CASES  OF  THE  QUADRATIC  SPLINE  OPTIMIZATION 
PROBLEM 


The  quadratic  spline  function  r(t)  is  given  by  (4.14).  In  some  problems 

the  values  of  r(T  ) and  r(T.)  are  known  a priori  and  in  other  problems 
o t 

the  values  of  r(T  ) and  r(T  ) are  known  a priori.  When  this  is  the  case 
o o 

such  knowledge  reduces  the  dimension  of  the  coefficient  vector  q.  The 
following  cases  cover  a spectrum  of  applications. 


Case  1.  No  knowledge  about  r(t)  is  known  a priori.  In  this  case 


a (t;  T)  = a (t;  T) 


(4.37) 


(4.3  8) 


Case  2.  The  values  of  r(T  ) and  r(T.)  are  known  a priori: 
of 


r(T^)  . Cj 


r(Tj)  . 


(4.39) 

(4.40) 


For  this  case  it  is  convenient  to  redefine  the  data  d(t)  as 


1 
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T 


(t  - ^l-  ) 

^(t)  = <!(,)  - - Oj)  .'4-, 

I o 


4 . •}  1 ) 


and  to  define 


• • . > 

(rj,  r^,  - 


(4.42) 


and  a (t;  T)  with  the  components 


C^(t;  T)  = a^(t;  T)  - a^(T^;  T)  - 't / 


(4.43) 


for  j = 1,  2, , m+1.  This  case  with  c^  = c^  = 0 applies  to  the  ship 

classification  application. 


Case  3.  The  values  r(T  ) and  r(T  ) are  known  a priori: 
o o 


r(To)  = 


(4.44) 


f(T^)  = c 

o 3 


The  data  is  redefined  as 


d(t)  = d(t)  - c'  - c,  (t  - T ) 
13  o 


(4.46) 


In  this  case  the  vector  function  a (t;  T)  and  the  coefficient  vector  q 
are  given  by 


a (t;T)  « (a^(t:  T).  a.2(t;  T).  a^+i(t;T))  (4.47) 


(rj.  Tj.  - 


(4.48) 


Case  4.  The  value  of  given  a priori: 


r(T^)  = Cj 


(4.  4i') 


The  data  d(t)  is  redefined  as 


d(t)  = d(t)  - c, 


(4. 50) 


The  vector  function  a.  (t,  T)  and  the  coefficient  vector  a are  defined  as 


a^(t;T)  = (a^(t;T).  a2(t;  T).  — . a^^^(t;  T).  a^^gCt;  T)  (4.51) 


q = (rj, 


(4. 52) 


Case  5.  The  value  of  r(T  ) and  r(T  ) are  given  a priori: 
o 1 


r(T  ) = c 

o o 


(4. 53) 


r<Tj)  . Cj 


(4.  54) 


The  data  d(t)  is  redefined  as 


d(t)  = d(t)  - c^  - Cg  (t  - T^) 


(4. 55) 


The  vector  function  ^ (t,  T)  has  components 


a (t;T)  = a.(t;T)  - a (T^;  T) 

J J J 


(4. 56) 
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40 


for  j = 1.  2, , m + 1.  The  coefficient  vector  q is  defined  as 


..  ••  .. 

(r  , r , r ) 

1 2 m+1 


(4. 57) 


Case  K.  The  value  of  r(T^)  is  given  a priori 


r(T  ) = c„ 

o 3 


The  data  d(t)  is  redefined  as 


d(t)  = d(t)  - c (t  - T ) 
3 o 


The  vector  function  ot  (t,  T)  and  the  coefficient  vector  q are  defined  as 


OL  (t;  T)  = (a  (t;  T).  a _(t;  T)) 

~ ~ 1 m+2  "■ 


q - (r,.  .y  — , r^) 


4 
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CHAPTEK  V 


SOL.UTION  TO  POSED  PROBLEM  - AN  OPTIMAL  SPl.lNE  ME'I  HOD 

The  problem  is  to  maximize  f'(T)  of  (4.35)  with  respect  to  the  knot 
vector  T.  Several  gradient  methods  are  available  for  carrying  out 
the  optimization;  steepest  descent,  Newton-Raphson,  Newton,  Ciauss- 
Newton,  Fletcher-Powell  and  Davidon.  Newton's  method  is  appealing 
because  of  its  (quadratic  convergence  properties.  It  can  be  implemented 
since  the  Hessian  matrix  is  analytically  computable. 


I 

I 


The  derivative 

dE(T*^) 

5T 

^ higher  order  terms  (5.  1) 

If  E(T)  has  a maximum  at  T = T*^  then 


oE(T) 

has  a Taylor  series  expansion 


5E(T^)  d^E(T^) 

+ (T^  - T^) 


ST 


St2 


SE(T^) 

ST 


0 


(5.2) 


In  addition,  if  the  higher  order  terms  are  sufficiently  small  compared 
to  the  other  terms  of  (5.  1)  then  T^  can  be  approximated  by 


S^E(T®)  SE(ja) 

St2  3T 


(5.3) 
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Sufficient  conditions  for  the  existence  of  a local  maximum  value  of 
K(T)  at  T = are  given  in  [14.  15]  and  are  that  (5.2)  is  satisfied 
and  that 


1).  > 0.  i - 2.  4.  6,  --- 


(5.4) 


< 0,  i =■-  1.  3.  5.  — - 


where 


D, 


^nk  = 


^11 

Ei2  • • 

. Eli 

^21 

E22  • • 

• ^21 

Eil 

Ei2  • • 

• Eii 

'E(T^) 

. n.  k 

= 1.  2. 

(5.  5) 


(5.6) 


(5.7) 


Since  the  higher  order  terms  are  seldom  zero  the  optimal  value  T 
is  obtained  through  convergence.  That  is.  if  represents 

the  solution  of  <5.3)  for  the  kth  iteration  and  if  = ^k-f  1 j-^pj-esents 
the  solution  of  (5.3)  for  the  (k+1)^^  iteration  then 


A 

T 


limit 

k — CO 


(5.  8) 


Since 


^(T)  = b‘^T)  y (T) 


(5.  9) 


1 

j 


I 


\ 

i 

i 
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we  can  rewrite  F(T)  in  the  following  forms 
K(T)  - ^(T)  y (T) 

= 1^(T)  3 (T) 


(5. 10) 
(5.  11) 


In  much  of  the  following  development  the  argument  T will  be  left 

A 

out  of  the  various  functions  such  as  E,  q.  y,  B and  their  derivatives. 


. 5E  . BE 

Ihe  vector  — has  components 

o 1 0 1 , o i 2 


^E 

yr 


m 


These  components  are  given  by,  k = 1,  2, , m, 


dE  , AT  dy 

— — = 2 q — ±= — 


AT  OB  A 

- H H 


(5. 12) 


which  is  obtained  by  use  of  the  identify 


OB 


-1 


3Tl- 


- B 


-1  dB 


B 


-1 


(5. 13) 


The  elements  of  the  matrix 


d^E 

dT^ 


are 


given  by,  k,  n = 1,  2, , m, 


2 [ 


B 


-1  ^y 


3T, 


Tk 


AT  o-'y 
+ S 


oTj^oT 


AT  dB 
^ dT, 


AT  dB 

q 


B 


-1 


dT, 


B 


dTk 
-1  dB 


OT, 


AT  dB 
' ^ dT. 


B 


-1 


dT, 


A , AT  d“B  A 

^ ^ dT^OTn  ^ ' 


(5.  U) 
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I 

I 


( 'onsequontly,  in  order  to  solve  (5.3)  we  need  the  followinf?  computed 
for-  k,  n 1 , 2, , ni; 

. B,  B"^  ^ 


dB 


d^B 

aTkSTn 


Expressions  for  the  above  quantities  can  be  derived  for  each  case 
discussed  in  Section  4.4.  These  expressions  are  derived  for  Case  1 
in  Chapters  VI  and  VII. 
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CHAPTER  VI 


ANALYTICAL  EXPRESSIONS  EOR  THE  QUANTITIES  OF  CASE  1 


(i.  1 The  H Mati-ix 


The  elements  of  the  symmetric  matrix  B are  given  by 


T 


. = r ‘f  a (t)  ai  (t)  dt 
Ji  ^ J ^ 


T 

for  j,  i = 1,  2, , m+3  where  the  a's  are  defined  by  (4.  18)  - (4,  20). 

The  argument  T has  been  dropped. 


For  i = 1,2, , m+1,  define 

Z.  = Ti  - Ti_i 

Si  = Tf  - Ti 


(6.  1) 
(6.  2) 


For  i =1,2. , rn+1  the  following  equations  can  be  derived: 

Si  . Si^  + Si3  (6.3) 


11  20 


For  i = 1,  2, , m the  following  equation  holds: 


_ ^ f ^i+1  r 

'^i(i+D  ^i  ^i+1  ^ 12  ^2 


Si 


" 1 ^ 3 


[ Zi  Si^i  - Zi+i  Si  ] 1 


(6.  4) 
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The  following  equation  has  been  derived  for  i = 1,  2, m-1; 

j = i + 2, , m ^ 1; 


b; 


Z;  Z 


z,- 


ij 


2 2 
(^■i-1  ^ ^.1  ) 


(s 


j 


2 


- A ’ 


Equations  (6.  6)  and  6,  7)  hold  for  i = 1.  2, , m + 1. 

2 


i (in+2)  6 


Zf  Z^  Z,i  2 


h (m+3)  ‘o  ■ ^ *’i  (m+2)  * 

Zi"^  Zi^  ^ r,  Zi  Si^ 


2-1 


li_  C.2  4. 


(m+2)  (m+2) 


T,  - T 
f o 


(m+2)  (m+3) 


(Tf  - T_) 


r,,  j2 

O 


(m+3)  (m+3) 


(T.  - T r 

f o 


(6.  5) 

(6.  b) 

(d.  7) 
(6.  8) 
(C.b) 
(6.  10) 
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6.2  'I'he  Matrix 




The  elements  of  are  denoted  by 

31k 


= b..  , 

3Tk  ij.  k 

(6. 11) 

Note  that 

b-  k ~ ® unless  i,  j = k or  k + 1 

(6.  12) 

The  following  equations.  (6. 13)  - (6. 23),  hold  for 

k = 1,  2, , m: 

In  addition.  Equations  (6. 13)  and  (6.  14)  hold  for  j = 1, 

2.---.  k-1: 

Zi  0 Sk  Z-j 

‘■jk.  k ■ + Sk2  ( Sj  - X W 

(6.  13) 

^j(k+l),  k ^jk.  k 

(6.  14) 

'^kk,  k " ^k  ^k  + 2 ^ 

(6.  15) 

4 2 

ZkM  Sk  4Sk  „ 

'’k(k+D.  k ■ 24  4 ^3  '^k+1  ‘ ^k^ 

(6,  16) 

- 2,  ^ 
^k  + 1 


(k+l)  (k+1) , k 


<1  \ 


-.4  2 

= - -^-k+l  - S.  Z 


12 


Zk+1 


k k+l 


(6. 17) 
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Note  that 


^kk,  k ^ ^k+l)(k+l).  k '^^k(k+D.  k 


Equations  ((>.  18)  and  (6.  19)  hold  for  j 

2 


k+2,--T  m + 1 : 
2 


- e 


Si  -1  + Z 


-)  (S^--) 


A ^3 
12 


(6. 18) 


*^(k+l)j,  k ^kj,  k 


Sk^ 


k (m+2),  k 


k (m+3),  k 


3 ^2 

Sk  ^k 


^ (Tf  - To) 


(6. 19) 

(6. 20) 

(6.21) 


^(k+1)  (m<-2),  k ^k  (m+2),  k 


^k+l)(m+3).  k ■ \(m+3),  k 


(6.22) 

(6.23) 


6.3  The 


Matrix  for  k = n;  n = 1,  2, , m. 


The  elements  of  ^^^^2  denoted  by 

n 


ii 


aT  2 
n 


b.  . 

ij.  nn 


Note  that 


9 

dT 


0 unless  i or  j = n or  n+1 


Equations  (6.  25)  and  (♦).  26)  hold  for  i = 1,  2, , n-1; 


bin , nn 


Zi  S 


1 -3n 


(Si  + Si_i  - Sn) 


bi(n+l).  nn  " " ^in,  nn 


-’nn,  nn 


“ " ^n  ^n  ^n-1  + 


2Sn^ 


, -7  Q C , ^n-Hl  2Sn~ 

b(n-+l)  (nfl),  nn  - Sj^  on+1  + ^ 2 


*^n(n+l),  nn 


bnn , nn  ^ ^(n-H)  (n-^l).  nn 


Equations  (6.30)  and  (6.31)  hold  for  j - n-i-2, , 


bnj.  nn  = - 


^1  ^1-1 


*^(n+l)j,  nn  " ’ '^nj,  nn 


bn(m+2),  nn 


- S. 


^n(m+3),  nn  2 


^(n+1)  (m-i-2),  nn  " “ '^n(m-f-2).  nn 


^(n+1)  (m-t-3),  nn  " " ^n(m-f3),  nn 


(6.24) 

(6.25) 

(6.26) 

(6.27) 

(6.28) 

(6.29) 

(6.30) 

(6.31) 

(6.32) 

(6.33) 

(6.34) 

(6.35) 
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t 


6.4  The 


d^B 


Matrix  for  k = n+1;  n - 1,  2, , m-1, 


The  elements  of 


;r;= 3r;fr—  are  denoted  by  b..  , . . 

^^n+1  ij.  (n+1)  n 


Note  that 


(n-1)  n " 0 unless  i and  j = n,  n+1  or  n+2 

(6,36) 

t>nn,  (n+1)  n * 0 

(6.37) 

„ ^ ^n+1  ^n+1 

'^n(n+l),  (n+1)  n 

s„+l  < 3 + 2 ) 

(6.38) 

t>n(n+2),  (n+1)  n “ 

■ t>n(n+l),  (n+1)  n 

(6,39) 

'^(n+l)n,  (n+T)  n 

t>n(n4  1),  (n+1)  n 

(6.40) 

^(n+1)  (n+l),  (n+1) 

n ■ 2bn(n+l),  (n+i)  n 

(6.41) 

'^(n+1)  (nt2).  (n+1) 

n ~ ^n(n+l),  (n+1)  n 

(6.42) 

*^(n+2)  n , (n+1)  n ~ 

“ ^n(n+l),  (n+1)  n 

(6.43) 

b(n+2)  (n+1),  (n+1) 

n ■ '^n(n+l) , (n+1)  n 

(6.44) 

^(n+2)  (n+2),  (n+1) 

n = 0 

(6.45) 

I 
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6.5  The  „ Matrix  for  k = n.  2.  -■ 


m;n-  1,2, , m-2 


^ r5 

The  elements  of  — are  denoted  by  bjj  ^ 


Since  B is  symmetric  we  consider  only  those  elements  bj.  with  i^*'  j. 


bi-i  , =0  unless  i = n or  n+1  and  i = k or  k+1 

iJ.  kn  •’ 


2 Sn  Sk 

bnk.  kn  = ) 


bn(k+l),  kn  ■ “ b^k,  kn 


b(n+l)k,  kn  “ ■ bnk,  kn 


b(n+l)  (k+1),  kn  ~ bnk,  kn 


6. 6 The  y Vector 


The  elements  of  y are  given  by 


Tj  = J d(t)  aj  (t)  dt 


(6.46) 


(6.47) 


(6.48) 


(6.49) 


(6.50) 


(6.51) 


for  j = 1,2,  m+3.  Since  the  data  d(t)  is  given  in  discrete 

form  rather  than  continuously  we  write  the  discrete  form  of  (6.51)  as 


Tf  - To  1 


where  I is  the  number  of  data  points  and  where 


(6.52) 


di  = d(tj).  i = 1,  2.  1 


= tj  + At 


(6.53) 


(6.54) 


Tf  - To 
1 


(6.  55) 


At 

T + — 


(6. 56) 


T ^ 

T" 


(6.57) 


For  j = 1,2. , rn  define  the  integer  J(j)  so  that  it  satisfies 

the  inequalities 


tj(j)  ^ ^ ^J(j)+1 


(6. 58) 


Consequently,  is  given  by 

m-To)  , ■>»>  , 
n = i t ^ di 2 

1 

I ,,,  y - TO  L d^}  (6.59) 

^i^i  2 i=J(l)+l 

i=J(l)+l 


For  j = 2,  3.  m.  yj  is  given  by 

('Tf-To)  r 

y = j (E  d. 

i=J(j-l)+l 

I Zj 

^ d.ti  + Zj(^ 

'*  i=J(j)+l 


(ti  - Ti-i)^ 
2 


- Tj)  E di]  (6.60) 
i=‘J(.))+l 


Furthermore,  Vm+l  given  by 


I 


ym+ 1 “ 


— i ^ E d.  Lm> 

i=J(m)i^l  ^ ^ 


1 


and,  ^014  2 71X1+ 3 have  the  equations 


^m  f 2 


ym+3 


(Tf  - To)  i 


I 


E d, 


i=l 

(Tf  - Tq)  I 


I 


2 di  (tf  - To) 

i=l 


6.7  The 


dy 


Vector  for  k = 1,  2, , m 


dy 

The  elements  of — = are  denoted  by 


dy, 


ST. 


’^J,  k 


From  (6.59)  - (6.61)  we  derive 


1^  = 0 j = 1,  2.  ---,  k-1 

(Tf  - To) 


T'k.  k = 
>'(k+l),  k 


I 


1 

L-  df  (ti  - T^,) 

i=.l(k)f  1 


’'k.  k 


= 0 j = k+2, , m+3 


(6.61) 

(6.62) 
(6. 63) 


(6.64) 

(6.65) 

(6.66) 

(6.67) 

(6.68) 


I 
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(i.H  'I'he  Tr,. — Vector  for  n=  1,  2, — 


The  elements  of 


are  denoted  by 


aTk^Tr,  kn 


For  k / n we  note  that 


’'j.  kn  = »•  J = 1.  2-  — • “+3 


For  k = n we  can  check  that 


y,  =0  unless  i = n or  n+ 1 
^j.  nn 


m , nn 


(Tf  - To) 
1 


i=J  (n)+l 


^(n+1) , nn  " ^n  , 


(6.73) 
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C HAPTER  VII 


ANALYTK'Al.  EXPRESSIONS  FOR  ^ ANU 

STk 

Ov 

In  Section  6.7  it  is  shown  that  the  vector  has  at  most  two 

nonzero  components.  In  Section  6.2  it  is  shown  that  the  matrix 
oB 

■5-;—  has  at  most  two  nonzero  rows  and  two  nonzero  columns.  The 
k 

sparseness  of  the  nonzero  elements  in  these  vectors  and  matrices 

dE  o^E 

greatly  facilitates  the  calculations  of  —7;; — and  — ■ . The 

dTii  or^dTri 

formulas  for  these  derivatives  are  given  in  this  section. 


It  is  convenient  to  make  the  following  definitions  for  n = 1,  2, , m; 

k ^ 1.  2, , m; 


m+3 

V - ‘In  - Tn.  n 


(7.  1) 


^ Wn.  nn  ^i  " (Qn  " ^n+l)  *^nn,  nn 
i-1  2 


(7.  2) 


^nk  ' Nik  ■ '^n(k+l)  " *^(ntl)  (k-^1) 


(7.3) 


m+3  m+3 

' I.  = L'  L h.  b,,  , h.. 

nk  in,  n ik,  k ii 

1=1  3=1  j * j 


(7.4) 


; , = E b.  (h.,  - h. 

nk  in,  n ik  1 (k+1) 


where  the  matrix  H is  given  by 


H = B 


(7.6) 


r 


with  elements  h-j,  i.  J = 1.  2, , mi  3. 


Note  that 


\k,  k ^ ^(kfl)  (k^l).  k 


^nn,  nn  ^(n*l)  (n-il),  nn 


2 b 


k (k+1).  k 

2b, 

n (n+1),  nn 


(7.7) 

(7.8) 


The  following  analytical  expressions  have  been  derived,  having 
made  use  of  (7.7)  and  (7.  8): 


^T. 


' ‘^k+l^^k,  k 


(7.9) 


A-r  A 

1 ^ ^ 


“^^k  ' *^k+l^  ^k  ^‘^k  ’‘^k+1^  \k,  k 


^ ^^k  ' ^k+1^  k ’ "^k^  ” ' '^k+l^  \k.  k 

k 


2 

T 


8T,  8T 
k n 


T a^y 


3T 


= 0 for  k n 


y (q  - q , 1 ) 

n,  nn  ^n  n+1 


(7.  10) 
(7. 1 1) 
(7.  12) 

(7.  13) 


Sy 


B 


-1 


3T  " ST, 
n k 

AT  SB  ^-1  ay 
“ ^^k  ax, 

h 

AT  ^-1  by 

“ "^k  ax 


y y f 

^n,  n ^k,  k nk 


(7. 14) 


> =nk  " f„k 

(7. 15) 

> °kn  * 'nk  *k) 

(7. 16) 

For  n = 1,  2, , m-1  and  k = nH,  n-ii!, 

that  (7.  17)  holds : 


in  it  can  In*  shown 


AT  9 B 


1 9T,  9T  y. 


^nk,  kn  ^^n  ^n+1^  ^^k  ^k+1^ 


(7.  17) 


' k n 

For  n = k it  can  be  verified  that  (7.  18)  holds; 


AT  9“H  A 

_ j 1 n ' 


q J C 
ni-1  n 


(7. 18) 


AT  9B  -1  SB  A 

q'  B q = A A,  f ^ + (q  - q ^.  ) A ,G  , ^ 

2 ST  S T,  2 n k nk  n n+1  k nk 

k 


* <%  ■ V.X'lk  - Vl’^nk 


(7.  Ih) 


Consequently,  it  follows  from  (7.  12),  (7,  14)  - (7.  17)  and  (7.  19)  that 
the  following  Equation  (7,  20)  holds  for  k = n and  Equation  (7.  21)  holds 
for  k / n: 


S^E 

ST 


2 { f 

- y 

^ nn 

n 

' n,  n 

nn 

C c (q 
n ^1 

nn 


2 G (A  - y ) 
nn  n n,  n 


(7.20) 
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C HAl^TEH  VIIJ 


ANALYTICAL  KNLKESSIONS  LOH  'J'HE  QUANTITIES  OL  THE 
SHIP  CLASSILICATION  CASE  - CASE  2. 


8.  1 The  H Matrix 


'I'he  elements  of  the  symmetric  matrix  B are  given  by 


P = f c-  (t)  rv(t)  dt  i,  j = 1.  2,  m+1 

^ i J 
o 

where  the  a's  are  defined  by  (4.43).  Integrating  (8.  1)  after  the 
substitution  of  (4.43)  gives 


8 . = b.  + a.  a,  b,  " a.  b , 

ij  ij  1 j (m+3)  (m+3)  i ^ (m+3) 


(Tj  - ) 


(T^  - T ) 
f o 


■ ^ t)  i.  ] = 1.  2,  m+1 

1 1 (m+3). 


(T,  - T^) 
1 o 


where  b. . is  defined  in  Section  6.1  and  where 
ij 


a.  = Z.  (S.  + Z.  ),  i = 1,  2, , m+1 

1 11  1 


8.2  The 


Matrix 


The  elements  of 


are  denoted  by 


(8.4) 


Nol(*  that 


8 =0  unless  i,  j = k or  k-^1 

ij.  k 

The  following  equations,  (b.6)  - (8.10),  hold  for  k = 1,  2,  , m; 


Equations  (8.6)  and  (8.7)  hold  for  j = 1,  2.  ---,  k-1  and  for 
j = ki  2, . rn+  1 . 


^jk,  k *^jk,  k 


^k  '^j(m^3) 


(Tf  - T^) 


(T  - T ) 
I o 


(T,  - T^) 


(m+3)  (m+3) 


(m+3)k,  k 


j(k+l),  k 


Jk,  k 


^ , = b + ^ b,  ^W(m+3)  + 

^kk,  k \k,  k -p= ;^,2  (m+3)(m+3) ^ 

'^f ■ o'  ^^f  ■ 'o' 


2b(m+3)k,  k ^k 

<T,  - T^) 
f o 


(8.8) 


^(k+l)k,  k ^k+l)k,  k ^(m+3)(m+3)  ^\+i  ' ^k^  ^1 


<Tf  - T^) 


(m+3)k,  k ^^k+1  ' 


(T^  - T^) 


(T  - T ) (^(m+3)k  ■ ^m+3)(k+l)) 
I o 


(8.9) 


®kk,  k ^ ^(k+l)(k+l),  k ~ ^ ®(k+l)k,  k 


(8. 10) 
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Equations  (8.  12)  and  (8.  13)  hold  for  i = 1,  2. , n-1,  n-2, . m+1: 


^(n+l)n,  nn  ^(n+l)n,  nn  ^ ^(m+S)(m  <-3)  ^n+1  ““"n 

(T,  - 


(T^  - T^)  ^ ^(m+3)(n+l)  ^{m+3)n  ^ ^(m+3)n,  nn  ^^n  ^n+1^ 


4S  b,  } 

n (m+3)n,  n 


(8.  15) 


R -i-  R = “ 2 fi 

°nn,  nn  ^(n+l)(n+l),  nn  ^{n+l)n,  nn 


(8.  16) 


2 

8.  4 The  ^ Matrix  for  k = n+1;  n *=  1,  2, , m-1, 

o 1 , o i 
k n 


The  elements  of  mr are  denoted  by 

o 1 , 1 o i 

n+1  n 


8T  .,9T 
n+1  n 


Tj,  (n+l)n 


(8. 17) 


Note  that 


B. . , , . = 0 unless  i and  i = n,  n+1  or  n+2 

ij,  (n+i)n 


(8. 18) 


nn,  (n+1)  = 0 


^(n+l)n,  (n+l)n  ^(n+l)n,  (n+l)n  ^n  ^n+1  ^(m+3)(m+3)  + 

(T.  - T )^ 
f o 


(T^  - Tq)  ^ ^n+1  *^(m+3)n,  n ^ ^n  ^(m+3)(n+l ),  n+1]  (8.19) 
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^n(n+2),  (n+l)n  ^n(n+l),  (n+l)n 


^(n+l)n,  (n+l)n  ^n(n+l),  (n+l)n 


^(n+l)(n+l),  (n+l)n  ^^n(n+l),  (n+l)n 


^(n+l)(n+2),  (n+l)n  ^n(n+l),  (n+l)n 


l3 


(n+2)n,  (n+l)n 


- 8 


n(n+l),  (n+l)n 


^(n+2)(n-+ 1 ),  (n+l)n  ^n(n+l),  (n+l)n 


^(n+2)(n+2),  (n+l)n  ^ 


8.  5 The 


dT,  9T 
k n 


Matrix  for  k = n+2, , m;n=l,  2, , m- 


The  elements  of 


b^B.. 

Ui 

dT,  ST 
k n 


S^B 

ST,  ST 
k n 


are  denoted  by 


ij.  kn 


Since  B is  symmetric  we  consider  only  those  elements  B- 
with  i < j. 


B-  ■ , - 0 unless  i = n or  n+1  and  i = k or  k+1 

1],  kn 


(8. 20) 
(8. 21) 
(8.  22) 
(8.  23) 
(8.  24) 
(8.  25) 
(8.26) 


(8. 27) 
(8.  28) 
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S . , = b , , " b.  . + 

Ilk,  nk  nk,  nk  k (m+3)n.  n 

(T^  - T^) 


r ^k  ^(m+3)(m+3) 
" ‘ (T,-T)^ 


(m+3)k.  k 

(T.  - T ) 
f o 


8.  6 The  5^  Vector 


The  elements  of  5^  are  given  by 


6 . = r^f  d(t)  a.(t)  dt 
J 'P  J 

o 

for  j = 1,  2, , m+1.  Making  use  of  (4.  43)  we  obtain 


'j  ' h ■ ^ • J ' 1-  2.  — . 

<Tf  - To) 


8.7  The  — Vector  for  k = 1,  2, , m. 


The  elements  of 


d6 

9T. 


are  denoted  by 


afi 


BT, 


It  can  be  shown  that 


a.  . = 0 j = 1,  2, , k-1,  k+2,  m+1 

J>  k 


(8.29) 


(8.  30) 


(8. 31) 


(8.  32) 


(8.  33) 
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The  Equations  (8.  34)  and  (8.  35)  hold  foi’  j = 1,  2 


m; 


1 


i 


6.  =7. 

J.  J J.  J 
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<Tf  - '‘'o> 


m+3 


(8. 34) 
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(8. 35) 


8.8  The 


ST,  ST 
k n 


Vector  for  n = 1,  2, , m;  k = n,  n+1, , m. 


s^fi 

The  elements  of  are  denoted  by 

ST,  ST 
k n 


ST,  ST 
k n 


6. 


j.  kn 

For  k / n we  note  that 


(8. 36) 


6j  kn  " ' J " m+1  (8.37) 


For  k = n we  can  verify  that 

6 . =0  unless  i = n or  n+1  (8. 38) 

J,  nn  ■> 


tlie  same  form  as  given  in  Chapter  VII.  It  is  only  necessary  to  substitute 
6 for  2 and  8 for  b.  It  is  important  to  modify  the  data  d(t)  according  to 
Equation  (4.  41)  before  computing  the  vector  fi  and  its  derivatives  of 
Section  6.6  -6.8  for  their  use  in  Sections  8.6  - 8.  8. 
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CHAPTER  rX  i 

i 

( 

1 

1 

ANALYTICAL  EXPRESSIONS  FOR  THE  Ql'ANTlTJES  (;F  CASES  3-6.  : 

The  analytical  expressions  for  Cases  3 and  4 are  the  same  as  for 
Case  1;  the  only  differences  are  (1)  the  dimension  of  the  vectors  q 
and  a and  (2)  the  summaUions  of  Equations  (7.1,  7.2,  7.4  and  7.5) 
are  carried  out  over  the  dimension  of  q.  Case  6 is  similar. 


9.  1 The  B Matrix  for  Case  5 

The  elements  of  the  symmetric  matrix  B are  given  by 

8 = b,.  - a.  b ..  - a.  b.  +a.  ^.b  (9.1) 

^ ij  ij  j (m4  2)i  1 (m+2)j  i j (m+2)(m*2) 

where  the  a.'s  are  defined  by  (8.3)  and  the  b's  are  given  in  Section 
6.1.  Comparing  (9.1)  with  (8.2)  we  note  that  the  analytical  expressions 
of  B and  its  derivatives  have  the  same  form  as  in  Case  2;  it  is  only 
necessary  to  make  the  following  substitutions  together  with  their  partial 
derivatives; 

substitute  b,  for  b, 

(m+2)  (m+2)  (m+3)  (m+3) 

(T.  - T 
1 o 

substitute  '".(meS) 

"t  - T„) 

9.  2 The  ^ Vector  for  Case  5 
The  elements  of  8 are  given  by 


(9.2) 

(9.3) 
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r ^ 


^ - y " •)  ,in*l  (9.4) 

Consequently,  in  view  of  Equation  (8.31)  the  analytical  expressions 
for  iS  and  its  derivatives  in  Case  5 have  the  same  form  as  C ase  2; 
it  is  only  necessary  to  make  the  following  substitution  together  with 
its  derivatives; 

substitute  y _ for  y (9.  a) 

m+2  m+3 

(T  - T ) 
t o 

It  is  necessary  to  modify  the  data  d(t)  according  to  Equations  (4.46, 

4.  50  and  4.  55)  before  computing  the  y and  its  derivatives  of  Sections 
6.6  - 6.8  for  their  use  in  Cases  3-5. 
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rilAPTKR  X ; 


PHOC'El)l  l{E  FOR  STARTING  ESTIMATES  OF  KNOTS 


In  this  section  we  describe  a method  for  generating  a starting  estimate 
for  the  minimum  number  of  knots  and  starting  estimates  for  the  knot 
values. 

10.  1 A Procedure  for  Estimating  the  Minimum  Number  of  Knots 

/■N-/ 

Let  M be  an  integer  and  let  the  knots  T-.  i = 1,  2, , M be  equally 

spaced  across  the  time  interval  [T^,  T^J.  Equation  (4.29)  or  (5.9)  can 

be  solved  for  the  values  of  q^,  i = 1,  2, , M+3.  The  error  E(q,  T) 

can  be  computed  using  Equation  (4.24).  If  the  error  falls  outside  a 
required  degree  of  accuracy  then  the  value  of  M is  increased  until  the 
computed  error  lies  within  a required  degree  of  accuracy.  When  this 

is  the  case  the  spline  coefficients  q-,  i = 1,  2, , M*1  are  sequentially 

grouped  in  order  , timewise,  according  to  positive  or  negative  values. 
For  example,  if  q^  is  positive,  q2<  P3  and  q^  negative  and  q^  and  q^ 
positive  with  q,,  negative  then  q^  forms  the  first  group,  q2>  q3>  and  q_j 
the  second  group  and  q^  and  qg  the  third  groups,  etc.  A single  spline 
region  is  designated  to  span  each  group  of  positive  values.  The  same 
is  true  for  each  series  of  negative  values.  The  number  of  groups 
determine  the  starting  estimate  for  the  minimum  number  of  knots. 

Let  m4  1 represent  the  number  of  such  groups. 


10.2  A Starting  Estimates  Procedure  for  the  Knot  Locations 

The  times  separating  the  above  groups  provide  excellent  starting 
estimates  for  the  knot  locations.  F'or  example,  the  times 
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t = T , for  some  i 
in  j 

can  be  used  as  excellent  starting  estimates  for  the  sequence  of  knots 

T, , T,,  T„,  ....  T that  are  used  in  the  Optimal  Spline  Method  of 
12  3m  r-  r- 

Chapters  VI-IX. 

2 

With  reference  to  Equation  (4.  1)  let  a denote  the  variance  of 
the  data  to  be  splined.  In  the  system  identification  of  aircraft  the 
following  procedure  works  well  for  estimating  the  minimum  of  knots 
and  for  providing  starting  estimates  of  the  knot  locations.  The  knots 
are  recursively  located  so  that  the  RMS  value  between  the  data  and  the 
spline  fit  is  approximately  equal  to  a over  each  spline  region.  This 
is  accomplished  by  placing  the  first  knot  so  that  the  first  spline  region 
is  the  maximum  of  all  spline  intervals  that  have  an  associated  KMS  less 
or  equal  to  a.  Each  succeeding  knot  is  similarly  placed. 


I 

i 

I 
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C liAl'  J'Kl{  \\ 


C'ONC  IA  SIOXS 

An  automated  technique  called  the  Optimal  Spline  Method  has  been 
developed  for  application  to  problems  having  high  nonlinearities,  its 
application  to  ship  classification  and  to  aircraft  system  identification  has 
solved  a major  problem  in  each  of  those  technological  areas.  These  are; 

(a)  the  development  of  a technique  to  determine  independent  features  for 
classification  of  ship  types  and  (b)  the  development  of  a method  that  mini- 
mizes the  number  of  parameters  that  are  necessary  for  optimal  estimation 
of  force  and  moment  time  histories  in  aircraft  system  identification. 

The  Optimal  Spline  Method  in  ship  classification  applications  deter- 
mines the  number  of  separate  superstructure  masses,  their  separation  from 
each  other,  their  locations  and  their  extended  widths.  These  independent 
features  correspond  directly  to  optimal  spline  coefficients  of  the  method. 

The  results  contained  in  Chapter  II  show  that  ships  of  like  type  have  similar 
optimal  seline  coefficients  and  ships  of  different  types  exhibit  large  differ- 
ences in  thexr  optimal  spline  coefficients.  In  particular,  it  is  shown  that 
the  optimal  spline  coefficients  provide  a clear  destinction  between  a Dl.Cl 
class  and  a DDG  class. 

In  aircraft  system  identification  applications  the  use  of  the  Optimal 
Spline  Method  has  two  advantages.  They  are:  (a)  the  t.ompuations  and  the 
storage  requirement  of  the  estimation  process  can  be  significantly  reduced 
without  a decrease  in  estimation  performance  and  (b)  an  increase  in  esti- 
mation and,  therefore,  in  identification  performances  can  be  achieved  under 
the  constraint  of  a fixed  number  of  spline  parameters.  Advantage  (b)  is 
demonstrated  by  the  results  contained  in  Figures  3-1  through  3-4.  Figure 
3-4  shows  the  results  of  using  eight  equally  spav'ed  knots.  The  increase  in 
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pei  l'ormanoe  duo  Lo  the  application  of  the  Optimal  Spline  Method  is  showti 
in  l''igure  3-2.  Advantage  (a)  is  indirectly  demonstrated  by  the  results 
contained  in  Figures  3-1  through  3-4.  In  Figure  3-2  the  third  and  fourth 
knots  are  separated  by  0.82  seconds.  In  order  to  obtain  equivalent  per- 
formance through  the  use  of  equally  spaced  knots  it  is  necessary  to  space 
them  at  approximately  0.  82  seconds.  This  spacing  increases  the  number 
of  knots  from  eight  to  more  than  sixteen.  The  computations  and  the  storage 
requirement  increase  exponentially  with  the  number  of  knots. 
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